Human Generated Data

Title

Untitled (New York Nights)
Date

1975
People

Artist: Tod Papageorge, American born 1940
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P1996.23.2

Human Generated Data

Title

Untitled (New York Nights)

People

Artist: Tod Papageorge, American born 1940

Date

1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.4
Audience 98.6
Crowd 98.6
Paparazzi 95.7
Person 78.9
Person 67
Painting 66.2
Art 66.2
Person 65.7
People 65
Person 64.1
Rug 61.3
Person 60.8
Person 60.7
Person 60.5
Photographer 56.9
Interior Design 56.4
Indoors 56.4

Imagga
created on 2022-01-09

texture 26.4
grunge 26.4
pattern 23.2
black 21.9
old 18.8
blackboard 18.7
design 18.5
art 18.3
silhouette 17.4
dirty 17.2
aged 16.3
surface 15.9
sunglasses 14.3
retro 13.9
wallpaper 13.8
paint 13.6
grungy 13.3
textured 13.1
drawing 12
rough 11.8
collection 11.7
graphic 11.7
spectacles 11.6
ink 11.5
backdrop 11.5
stain 11.5
vintage 10.9
material 10.7
people 10.6
crowd 10.5
backgrounds 10.5
decoration 9.9
male 9.9
element 9.9
clothing 9.8
modern 9.8
splash 9.7
drip 9.7
close 9.7
liquid 9.6
ancient 9.5
man 9.4
floral 9.3
optical instrument 8.9
color 8.9
group 8.9
splatter 8.8
stone 8.8
antique 8.6
spot 8.6
wall 8.5
flower 8.4
shape 8.2
splat 7.9
silhouettes 7.8
spray 7.7
rusty 7.6
weathered 7.6
seamless 7.6
plants 7.4
digital 7.3
detail 7.2
wet 7.1
creative 7.1

Google
created on 2022-01-09

Organism 86.2
Style 83.8
Black-and-white 83.4
Font 80.8
Adaptation 79.2
Art 78.8
Snapshot 74.3
Monochrome photography 73
Monochrome 72.4
Pattern 71.5
Event 70.8
Crowd 65.9
Illustration 63.7
Metal 62.1
History 60.5
Circle 59.5
Visual arts 57.7
Pole 55.1
Team 54.1
Audience 53.6

Microsoft
created on 2022-01-09

text 97.2
drawing 94.4
posing 92
person 85.7
sketch 81.8
cartoon 79.2
white 75.4
black 74.1
group 57.4
crowd 1.2

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Female, 100%
Happy 99.8%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Sad 0%
Fear 0%
Calm 0%

AWS Rekognition

Age 18-24
Gender Male, 92.9%
Sad 45.8%
Fear 25.6%
Calm 16.8%
Happy 4%
Disgusted 3.3%
Surprised 2.5%
Angry 1.3%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Female, 100%
Angry 50%
Surprised 16.9%
Sad 16.8%
Calm 5.6%
Confused 3.5%
Fear 3%
Happy 2.3%
Disgusted 1.9%

AWS Rekognition

Age 42-50
Gender Male, 100%
Calm 63.1%
Surprised 11.7%
Sad 6.6%
Fear 6.4%
Happy 6.1%
Disgusted 2.4%
Confused 1.9%
Angry 1.8%

AWS Rekognition

Age 36-44
Gender Female, 99.7%
Calm 64.6%
Surprised 16.2%
Confused 7.2%
Sad 3.3%
Fear 2.7%
Disgusted 2.6%
Angry 2.6%
Happy 0.8%

AWS Rekognition

Age 45-51
Gender Female, 99.9%
Sad 65.1%
Calm 29.5%
Happy 2.2%
Confused 1%
Surprised 0.8%
Angry 0.6%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Female, 54.6%
Sad 41.8%
Disgusted 32.5%
Confused 8.5%
Surprised 7%
Happy 2.8%
Fear 2.5%
Angry 2.5%
Calm 2.4%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 86.7%
Confused 4.1%
Surprised 2.8%
Fear 2.4%
Sad 1.9%
Angry 1.2%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 100%
Disgusted 94.7%
Sad 2.4%
Calm 0.8%
Surprised 0.7%
Fear 0.5%
Angry 0.4%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 26-36
Gender Male, 70.2%
Calm 69.4%
Confused 12.4%
Happy 9.3%
Sad 3.6%
Angry 3.3%
Surprised 1.1%
Disgusted 0.8%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 88.6%
Sad 6.4%
Angry 1.7%
Happy 0.9%
Disgusted 0.8%
Confused 0.6%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 34-42
Gender Female, 100%
Sad 96.6%
Happy 1.9%
Calm 0.6%
Fear 0.5%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 13-21
Gender Female, 100%
Calm 52%
Sad 21.5%
Happy 16%
Surprised 2.8%
Angry 2.3%
Confused 2.2%
Fear 1.9%
Disgusted 1.2%

AWS Rekognition

Age 18-24
Gender Male, 94.4%
Sad 72.1%
Calm 11.2%
Happy 9.1%
Angry 3.8%
Confused 1.1%
Disgusted 1.1%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 23-31
Gender Male, 80.6%
Calm 52.1%
Sad 27.9%
Surprised 10.8%
Fear 3.2%
Confused 2.2%
Disgusted 1.8%
Angry 1.3%
Happy 0.7%

AWS Rekognition

Age 24-34
Gender Male, 97.3%
Sad 87.9%
Calm 9.7%
Happy 1.1%
Surprised 0.7%
Confused 0.2%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 35-43
Gender Male, 92.8%
Calm 98.7%
Sad 0.8%
Surprised 0.3%
Angry 0.1%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 96.5%
Disgusted 70.3%
Angry 22%
Calm 2.2%
Surprised 1.5%
Sad 1.4%
Fear 1%
Confused 1%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Happy 45.2%
Sad 34%
Calm 6.3%
Angry 3.5%
Surprised 3.5%
Confused 3%
Fear 2.9%
Disgusted 1.5%

AWS Rekognition

Age 34-42
Gender Female, 51.8%
Sad 78.2%
Calm 18.5%
Happy 0.8%
Disgusted 0.7%
Surprised 0.6%
Angry 0.4%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 38-46
Gender Female, 100%
Calm 41.4%
Sad 35.7%
Happy 6.6%
Disgusted 4.9%
Fear 3.3%
Confused 3.2%
Surprised 2.6%
Angry 2.3%

AWS Rekognition

Age 27-37
Gender Male, 86.1%
Calm 87.2%
Fear 6.5%
Sad 1.8%
Happy 1.3%
Angry 1.2%
Surprised 0.7%
Confused 0.6%
Disgusted 0.6%

AWS Rekognition

Age 23-31
Gender Female, 57.1%
Calm 88.8%
Happy 7.2%
Sad 1.2%
Fear 0.8%
Surprised 0.7%
Angry 0.6%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Male, 66.1%
Sad 62.2%
Calm 22.2%
Happy 5.6%
Angry 2.4%
Confused 2.2%
Surprised 2.1%
Fear 2%
Disgusted 1.4%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 99.9%
Sad 0%
Surprised 0%
Angry 0%
Happy 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 91.4%
Calm 99.5%
Sad 0.2%
Angry 0.1%
Surprised 0%
Confused 0%
Happy 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 78.9%
Painting 66.2%
Rug 61.3%

Captions

Microsoft

a group of people posing for a photo 93.3%
a group of people posing for the camera 93.2%
a group of people posing for a picture 93.1%