Human Generated Data

Title

Untitled (family on sidewalk)

Date

1986

People

Artist: Bruce Gilden, American born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Beinecke Fund, 2.2002.581

Copyright

© Bruce Gilden

Human Generated Data

Title

Untitled (family on sidewalk)

People

Artist: Bruce Gilden, American born 1946

Date

1986

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.8
Person 99.8
Person 99.8
Person 99.4
Person 99.1
Person 98.9
Person 98
Person 97.4
Person 90.6
Clothing 89
Apparel 89
Person 78.8
Person 78.7
Shorts 74.3
Person 73.5
Person 73
People 71.6
Vehicle 67.3
Transportation 67.3
Leisure Activities 62.8
Bicycle 62.6
Bike 62.6
Female 58.1
Musician 56.5
Musical Instrument 56.5
Advertisement 56.4

Imagga
created on 2021-12-14

person 28.4
adult 26.6
black 25.5
people 25.1
sexy 22.5
pretty 22.4
fashion 21.1
portrait 20.7
attractive 20.3
man 20.2
chair 20
wheelchair 19
model 18.7
smiling 16.6
women 15.8
sitting 15.5
lifestyle 14.4
male 14.3
professional 13.8
studio 13.7
casual 13.6
hair 13.5
smile 12.8
youth 12.8
dress 12.6
happy 12.5
seat 12.4
brass 12.4
brunette 12.2
20s 11.9
style 11.9
businesswoman 11.8
business 11.5
cheerful 11.4
wind instrument 11.2
clothing 11.2
expression 11.1
musical instrument 10.9
gorgeous 10.9
posing 10.7
couple 10.4
looking 10.4
car 10.4
two 10.2
cute 10
teenager 10
music 10
face 9.9
bag 9.5
men 9.4
elegant 9.4
happiness 9.4
elegance 9.2
vehicle 9.2
holding 9.1
make 9.1
stylish 9
lady 8.9
passenger 8.8
indoors 8.8
standing 8.7
musician 8.4
color 8.3
technology 8.2
equipment 8.2
job 8
working 8
together 7.9
urban 7.9
hand 7.6
city 7.5
feminine 7.5
outdoors 7.5
phone 7.4
laptop 7.3
sensual 7.3
sensuality 7.3
pose 7.2
office 7.2
furniture 7.1
love 7.1
to 7.1
modern 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

person 99.8
text 99.4
clothing 96.6
posing 93.9
group 76.6
black and white 73.4
people 66
human face 63.7
smile 62.9
man 62.8
woman 55.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 96.8%
Angry 90.6%
Confused 3.8%
Calm 2.6%
Fear 1.4%
Sad 0.8%
Disgusted 0.4%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 16-28
Gender Male, 57.7%
Sad 83.6%
Confused 7.4%
Fear 4.2%
Angry 2.4%
Disgusted 1.1%
Calm 0.7%
Surprised 0.3%
Happy 0.2%

AWS Rekognition

Age 32-48
Gender Female, 87.1%
Confused 79.2%
Angry 15.5%
Disgusted 3.1%
Calm 0.6%
Sad 0.6%
Surprised 0.5%
Fear 0.4%
Happy 0.1%

AWS Rekognition

Age 15-27
Gender Male, 81.7%
Calm 68.3%
Sad 15.4%
Fear 5.1%
Confused 3.6%
Angry 3.2%
Happy 1.7%
Disgusted 1.5%
Surprised 1.2%

AWS Rekognition

Age 26-42
Gender Female, 55.2%
Confused 60%
Sad 23.8%
Calm 9%
Angry 4%
Surprised 1.1%
Disgusted 1%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 3-11
Gender Female, 96%
Happy 28.3%
Sad 27.4%
Fear 22.5%
Calm 17%
Surprised 3.1%
Angry 0.9%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 38-56
Gender Male, 98.1%
Calm 73.3%
Happy 10%
Angry 5.8%
Sad 3.8%
Disgusted 2.9%
Fear 1.7%
Surprised 1.5%
Confused 1%

AWS Rekognition

Age 22-34
Gender Male, 50.9%
Happy 28%
Disgusted 20.1%
Fear 18.6%
Calm 15.4%
Sad 10%
Surprised 6.1%
Angry 1.3%
Confused 0.6%

AWS Rekognition

Age 26-40
Gender Female, 77%
Sad 59.2%
Calm 33.7%
Fear 3.4%
Confused 1.4%
Surprised 0.8%
Happy 0.6%
Angry 0.6%
Disgusted 0.3%

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 13
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 96.6%
a group of people posing for the camera 96.5%
a group of people posing for a picture 96.4%

Text analysis

Amazon

ISLAND
BEEF
CONEY ISLAND
FRANKFURTER
CONEY
100%ALL BEEF
MAT
100%ALL
TRANSPORTER
SOCIAL MAT
TOASTED
- TOASTED KOLL
e
KOLL
-
SOCIAL
ahmahuen

Google

CONEY SLAND 0ALL BEEF TRANKFURTER
BEEF
0ALL
TRANKFURTER
CONEY
SLAND