Skip to content

Commit

Permalink
Update mapped_api_develop from master (#131)
Browse files Browse the repository at this point in the history
* Fixing POM file to get rid of maven warnings

* Changed formatting checks to check for the Google formatting rules and adapted code to these rules. See https://google.github.io/styleguide/javaguide.html

* Changed to older version of checkstyle to be compatible with JDK 1.7

* Revert "Changed to older version of checkstyle to be compatible with JDK 1.7"

This reverts commit 7376b6a.

* Check Google code style only at the end and only using JDK1.8

* For the actual tests, stop at the integration-test phase rather than also verify. Run verify once, separately and using JDK8 only.

* Reverting some changes in jms-light/pom.xml that might have somehow influenced the global behavior of maven

* Added a timeout while waiting for the fake server to terminate

* Fixing POM file to get rid of maven warnings

* Changed formatting checks to check for the Google formatting rules and adapted code to these rules. See https://google.github.io/styleguide/javaguide.html

* Changed to older version of checkstyle to be compatible with JDK 1.7

* Revert "Changed to older version of checkstyle to be compatible with JDK 1.7"

This reverts commit 7376b6a.

* Check Google code style only at the end and only using JDK1.8

* For the actual tests, stop at the integration-test phase rather than also verify. Run verify once, separately and using JDK8 only.

* Reverting some changes in jms-light/pom.xml that might have somehow influenced the global behavior of maven

* Added a timeout while waiting for the fake server to terminate

* Put tests back, but disable them

* add go subscriber loadtest (#74)

* typo

* add go subscriber

* automatically compile go loadtest binary

* pr comment

* Add PubSubTemporaryTopic class

* Improves error messages, enables Go message tracking.

* Update README.md

* Update README.md

* Update README.md

* Fix null key and exception about read-only ByteBuffer that happens wh… (#78)

* Fix null key and exception about read-only ByteBuffer that happens when using a JsonConverter in a source connector.

* Fix null key and exception about read-only ByteBuffer that happens when using a JsonConverter in a source connector.

* added source file

* nit

* nit

* nit

* use public access

* use extends

* Moved mockito and junit to the test scope. Removed the dependency on the kafka client. This is provided by the connect-api. Changed the scope of connect-api to provided. Updated the kafka version to 0.10.2.0. (#84)

* nit

* Initial version of PubSubMessageConsumer.

* added file

* added constructor

* nit

* fix pmd

* nit

* nit

* added file

* added -Xlint:all to all compile

* Xlint Configuration

This is the configuration that I used. With this, I get the following warnings (the second one is probably independent of -Xlint):

...
[WARNING] /usr/local/google/home/uhu/src/pubsub/jms-light/src/main/java/com/google/pubsub/jms/light/message/PubSubTextMessage.java:[39,16] unchecked cast
  required: T
  found:    java.lang.String
...
[WARN] /usr/local/google/home/uhu/src/pubsub/jms-light/src/main/java/com/google/pubsub/jms/light/PubSubTopicSession.java:9: Wrong lexicographical order for 'com.google.pubsub.jms.light.destination.PubSubTemporaryTopic' import. Should be before 'javax.jms.TemporaryTopic'. [CustomImportOrder]
[WARN] /usr/local/google/home/uhu/src/pubsub/jms-light/src/main/java/com/google/pubsub/jms/light/PubSubTopicConnectionFactory.java:12: Line is longer than 100 characters (found 109). [LineLength]
[WARN] /usr/local/google/home/uhu/src/pubsub/jms-light/src/main/java/com/google/pubsub/jms/light/PubSubTopicConnectionFactory.java:20: Line is longer than 100 characters (found 114). [LineLength]

* Resolved unchecked cast

* Cleaned code style, especially for test classes. This addresses Github JMS issue #92.

* nit

* nit

* Handle a null schema in the sink connector. (#94)

* Adding ${os.detected.classifier} to Pom (#96)

Just adding ${os.detected.classifier} to Pom so the right netty-tcnative-boring-ssl-static library is selected.
This is to ensure the connector can work in any OS (e.g. OSX).

* Fix concurrent access on iteration of synchronized set. (#98)

* Handle a null schema in the sink connector.

* Fix concurrent access on iteration of synchronized set.

* Reduce the ackIds iteration synchronization to the shortest period needed

* Make acks best effort. (#99)

* Clear list of ackIds as soon as acks are sent. This will make acks best effort, but also prevents us from forgetting to send some acks if a poll happens while there is an outstanding ack request

* Better error message when verifySubscription fails. (#100)

* Better error message when verifySubscription fails.

* When an exception happens on pull, just return an empty list to poll. (#102)

* Handle a null schema in the sink connector.

* Fix concurrent access on iteration of synchronized set.

* Reduce the ackIds iteration synchronization to the shortest period needed

* Clear list of ackIds as soon as acks are sent. This will make acks best effort, but also prevents us from forgetting to send some acks if a poll happens while there is an outstanding ack request

* Better error message when verifySubscription fails.

* When an exception happens on pull, just return an empty list to poll.

* don't depend on gRPC internals (#103)

* Don't reference gRPC internal classes

* don't depend on gRPC internals

* Create README.md

* Ensure that partition numbers are non-negative (#105)

* Ensure partition number is non-negative in CPS source connector.

* Update client library dependencies.

* Update Framework with Java Beta Client (#108)

* Update Framework with Java Beta Client

Updates the framework with the Java Beta client, and removes the
experimental client now that the changes have been merged into the
google-cloud-java repository.

* Remove previous "spi" from import paths

* Minor bugfixes, removed VTK since it no longer exists

* Remove unused startup scripts (#110)

* Remove Alpha Client Libraries, Redirect to google-cloud-java (#109)

* Remove Alpha Client Libraries, Redirect to google-cloud-java

* Removed client from .travis.yml

* readme fix

* lint fixes

* Added Ruby publisher

* updated publisher

* Added Ruby subscriber

* fixed comments

* fixes for CPS Subscriber, updates with new Python publisher

* python subscriber

* fix firewall

* Update run.py

Fix for python3

* Shade the guava library to avoid a NoMethodFoundError  (#117)

* Handle a null schema in the sink connector.

* Fix concurrent access on iteration of synchronized set.

* Reduce the ackIds iteration synchronization to the shortest period needed

* Clear list of ackIds as soon as acks are sent. This will make acks best effort, but also prevents us from forgetting to send some acks if a poll happens while there is an outstanding ack request

* Better error message when verifySubscription fails.

* When an exception happens on pull, just return an empty list to poll.

* Ensure partition number is non-negative in CPS source connector.

* Shade out the guava library so the connector can work with a newer version of Kafka that depends on a newer version of the guava library.

* Shade out the guava library so the connector can work with a newer version of Kafka that depends on a newer version of the guava library.

* fix

* Fix some broken markdown in the README (#119)

Some newlines snuck their way into these links

* Update run.py

Uncomment Go

* java: don't sync on shutdown (#125)

* java: don't sync on shutdown

Shutting down needs to wait for messages to be processed,
and processing the messages need to lock the Task object.
So, if the thread calling shutdown locks the Task object, we'll
deadlock.

* pr comment

* increase parallel puller count (#124)

* increase parallel puller count

The new default number of parallel pullers is NumCPU.
To keep up with publishers, we need to increase the number of pullers.
This commit increaes the number to 5*NumCPU,
the same as the old default.

* bump version

* Move away from very old versions of gRPC libraries (#130)

* Handle a null schema in the sink connector.

* Fix concurrent access on iteration of synchronized set.

* Reduce the ackIds iteration synchronization to the shortest period needed

* Clear list of ackIds as soon as acks are sent. This will make acks best effort, but also prevents us from forgetting to send some acks if a poll happens while there is an outstanding ack request

* Better error message when verifySubscription fails.

* When an exception happens on pull, just return an empty list to poll.

* Ensure partition number is non-negative in CPS source connector.

* Shade out the guava library so the connector can work with a newer version of Kafka that depends on a newer version of the guava library.

* Shade out the guava library so the connector can work with a newer version of Kafka that depends on a newer version of the guava library.

* Update versions of gRPC libraries used by Kafka Connector. This should hopefully fix issue #120.

* Edit travis script.
  • Loading branch information
mgewilli authored Oct 10, 2017
1 parent 8a0bdf8 commit eadf624
Show file tree
Hide file tree
Showing 94 changed files with 1,964 additions and 6,746 deletions.
5 changes: 2 additions & 3 deletions .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,9 @@ matrix:
jdk: openjdk7

script:
- mvn -q -B -f jms-light/pom.xml clean verify
- mvn -q -B -f jms-light/pom.xml clean integration-test
- mvn -q -B -f kafka-connector/pom.xml clean verify
- mvn -q -B -f client/pom.xml clean verify -Dmaven.javadoc.skip=true -Dgpg.skip=true -Dmaven.test.skip=true -Djava.util.logging.config.file=client/src/test/resources/logging.properties
- jdk_switcher use oraclejdk8
- mvn -q -B -f pubsub-mapped-api/pom.xml clean install verify
- mvn -q -B -f load-test-framework/pom.xml clean install verify

- mvn -q -B -f jms-light/pom.xml clean verify -Dmaven.test.skip=true
16 changes: 0 additions & 16 deletions client-samples/README.md

This file was deleted.

58 changes: 0 additions & 58 deletions client-samples/pom.xml

This file was deleted.

This file was deleted.

This file was deleted.

18 changes: 6 additions & 12 deletions client/README.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,6 @@
### Introduction

High Performance Cloud Pub/Sub Client libraries.

(NOTE) This client includes only data plane operations, publishing and
pulling messages, and it is based on our gRPC beta release.

(ALPHA) This library uses features that are part of an invitation-only
release of the underlying Cloud Pub/Sub API. The library will generate
errors unless you have access to this API. This restriction should be
relaxed in the near future. Please contact [email protected] with any
questions in the meantime.
The alpha client libraries in this directory have been replaced by the official
[Google Cloud Pub/Sub Java client library](https://github.com/GoogleCloudPlatform/google-cloud-java/tree/master/google-cloud-pubsub).
The semantics and performance improvements introduced in these alpha libraries
have been preserved and improved in the official libraries, so we strongly
encourage you to migrate. However, we have no plan to remove this code from our [Maven
repository](http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22com.google.pubsub%22).
Loading

0 comments on commit eadf624

Please sign in to comment.