* Add IAM config for natural language search
* Add IAM config for natural language search
* Add IAM config for natural language search
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* Fix : case-insensitive issue on aggregation and simplify aggregation API response format
* add lowercase normaliser for service.name.keyword
* add lowercase normaliser for database.name.keyword, databaseSchema.name.keyword, columns.name.keyword
* fix lowercase normaliser for database.name, databaseSchema.name
* create new aggregateRequest.json and update aggregate function
* remove sort field in subAgg and trackScores(false)
* cleanup function
* rename aggregation Field
* fix the search cases
* fix locales
* fix search
* add test case
* hide lineage search for higher level layers
* fix tests
---------
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Renamed DayOneApp to SmartStart
* Fix Checkstyle
* Change the day one app references in the UI
* Change Smart Start to Auto Pilot
* Adding autoPilotAppConfig.ts generated file
* fix
* Update the generated types
* Change the Auto Pilot to AutoPilot
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* chore: explicit types in appRunRecord.json
This does not change the actual schema of AppRunRecord so no database migrations are required. It improves the ergonomics of building a an app status.
* fixed AppLogsViewer.component.tsx
* modified AppUtils to use new schema
* added wide catcher
* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
* Add last login time
* Add change to entitySpecificUpdate
* remove last login time from createOrUpdate
* moved UpdateLastLogin to user repository
* Added last login Time on login (#20419)
* updated last login time
* removed condition
* added unit tests
---------
Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* Refactor SQL column processing and enhance BigQuery project ID handling
* Introduced a new `process_column` function in `sql_column_handler.py` to streamline column processing logic.
* Updated `BigquerySource` to improve project ID retrieval from service connections, ensuring compatibility with various credential types.
* Added handling for nested columns in BigQuery schema processing.
* Enhanced error handling and logging for better debugging during project ID setup.
* Add support for GCP Application Default Credentials in BigQuery ingestion
* Enhanced `BigquerySource` to include handling for GCP Application Default Credentials (ADC).
* Updated JSON schema for GCP credentials to define `gcpADC` and its properties.
* Improved logging for credential setup in `set_google_credentials` function.
* Added comments and TODOs for future enhancements related to project ID fetching from the resource manager.
* Update .gitignore to include cursor rules files
* Added .cursorrules and .cursor/ to the .gitignore to prevent tracking of cursor rule files in the repository.
* This change helps maintain a cleaner repository by excluding unnecessary files from version control.
* refactor: Bigquery Credentials to allow multiple project ids
* fix: Handle unknown array data types in SQL column processing
* feat: allow user to turn off rnadomized sample
* style: ran python linting
* fix: models default value for randomizedSample
* style: ran linting
* doc: move config to advanced
* Fix#19667: OpenSearch Connector
* Fix#19667: OpenSearch Connector
* do not ingest any system level indexes
* fix pyformat
* Add AWS auth
* Use common schema and fix ssl config in client
* Add openseach connector docs and update schema
* Remove api key auth type and complete docs checklist
* Remove unnecessary httpx dependency and pyformat
* Add compatible version of httpx for elasticsearch
* Fix pylint fails and py-tests validation error
---------
Co-authored-by: Mohit Tilala <tilalamohit123@gmail.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
* playwright: skip DI, superset & postgresql test
* skip the run part instead of skipping full test for DI settings
* Fix the postgres Ingestion playwright failure
* Fix the superset playwright
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* MINOR - Add AgentType to apps
* MINOR - Add AgentType to apps
* update the types according to the schema
* Fix the search lineage request schema
* Add pipelineStatuses field in the ingestionPipelineIndex
* Add MetadataAgentsListWidget
* Localization changes
* added list for app runs by service id
* use `$.services` path
* propogate services field
* Fix the ci type errors
* java format
* use `getJobDetail().getJobDataMap()` instead of `getMergedJobDataMap()`
* Fix the playwright and unit tests
* Fix the service version page playwright failures
* Fix sonarcloud
* Fix the unit tests
* Fix the errors
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: sushi30 <imri.paran@gmail.com>
