Human Generated Data

Title

Grand Central Station, NY

Date

1951

People

Artist: Larry Silver, American born 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bruce Silverstein, 2018.386

Human Generated Data

Title

Grand Central Station, NY

People

Artist: Larry Silver, American born 1934

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2020-03-11

Banister 100
Handrail 100
Human 99.1
Person 99.1
Photographer 91.3
Person 90.1
Staircase 76.6
Silhouette 61.3

Clarifai
created on 2020-03-11

monochrome 99.7
people 99.6
street 99
shadow 98.6
silhouette 98.1
man 97.8
step 97.4
girl 97.1
black and white 97
portrait 96.8
model 96.7
light 96.7
adult 96.2
city 95.8
art 95.1
woman 94.7
dark 93.9
music 93.5
contrast 93.3
reflection 92.1

Imagga
created on 2020-03-11

support 38.3
lighting 37.4
device 35.2
step 33.5
apparatus 29
equipment 24.1
light 22.1
silhouette 20.7
man 16.8
black 16.6
dark 14.2
metal 13.7
building 13.6
modern 13.3
structure 12.7
urban 12.2
chair 12.1
architecture 11.8
industrial 11.8
sky 11.6
window 11.3
industry 11.1
person 11
city 10.8
night 10.7
male 10.6
people 10.6
construction 10.3
spotlight 9.9
business 9.7
factory 9.6
technology 9.6
lamp 9.4
park 9.4
world 9.2
steel 8.8
sconce 8.6
travel 8.4
old 8.4
sun 8.3
pier 8.2
shadow 8.1
hair 7.9
adult 7.8
skin 7.6
tract 7.4
landscape 7.4
sexy 7.2
music 7.2
body 7.2
interior 7.1

Google
created on 2020-03-11

Microsoft
created on 2020-03-11

black and white 97.3
person 97.2
monochrome 95.1
text 91.4
clothing 90.3
outdoor 90
street 89.1
shadow 87.4
light 64.2
abstract 59.4
man 56.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 53.5%
Surprised 45.5%
Disgusted 45.1%
Fear 45.1%
Sad 45.1%
Happy 51.8%
Calm 47.2%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 27-43
Gender Male, 52.4%
Happy 45.1%
Fear 45%
Calm 54.9%
Sad 45%
Confused 45%
Angry 45%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 22-34
Gender Female, 54.4%
Fear 48.2%
Confused 45.2%
Disgusted 45.1%
Angry 45.1%
Surprised 45.4%
Happy 45.1%
Calm 46.9%
Sad 49%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people posing for the camera 69%
a group of people on a stage 60.7%
a group of people 60.6%