Human Generated Data

Title

Untitled (New York Nights)

Date

1975

People

Artist: Tod Papageorge, American born 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P1996.23.5

Human Generated Data

Title

Untitled (New York Nights)

People

Artist: Tod Papageorge, American born 1940

Date

1975

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Davis Pratt Fund, P1996.23.5

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Clothing 99.4
Apparel 99.4
Person 98.5
Person 98
Person 97.3
Person 95.9
Person 95.2
Person 93.9
Footwear 93.2
Shoe 93.2
Shoe 89.4
Painting 83.8
Art 83.8
Suit 70.8
Coat 70.8
Overcoat 70.8
Person 65.1
Person 61.9
Sitting 56.6
Shoe 51.9

Clarifai
created on 2023-10-25

people 100
group 99.5
man 99.1
group together 98.8
adult 97.7
two 97.3
three 97.2
woman 96.5
one 92.1
many 90.9
adolescent 89.5
wear 89.2
four 88.4
child 87.3
retro 86.9
several 86.3
transportation system 80.9
war 80.7
recreation 80.6
boy 77.7

Imagga
created on 2022-01-09

man 29.6
male 24.3
people 22.9
person 21.1
adult 20.8
sitting 17.2
couch 13.5
attractive 13.3
happy 13.2
professional 12.8
work 12.6
business 12.1
men 12
room 11.7
black 11.6
couple 11.3
hairdresser 11.2
looking 11.2
love 11
smile 10.7
worker 10.7
job 10.6
businessman 10.6
office 10.6
indoors 10.5
chair 10.3
happiness 10.2
salon 10
one 9.7
home 9.6
women 9.5
lifestyle 9.4
executive 9.2
back 9.2
indoor 9.1
interior 8.8
working 8.8
child 8.8
device 8.8
boy 8.7
smiling 8.7
face 8.5
youth 8.5
studio 8.4
patient 8.2
cheerful 8.1
cute 7.9
model 7.8
expression 7.7
employee 7.6
casual 7.6
fashion 7.5
horizontal 7.5
holding 7.4
car 7.4
inside 7.4
occupation 7.3
window 7.3
alone 7.3
sexy 7.2

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.8
text 99.3
clothing 98.2
man 90.4
footwear 83.7
black and white 75.4
people 69.1
group 59.1
woman 57.8
human face 51.9
crowd 0.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 99.9%
Surprised 0%
Sad 0%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 88%
Confused 7.5%
Angry 3.5%
Fear 0.3%
Sad 0.2%
Surprised 0.2%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Female, 99.9%
Fear 100%
Surprised 0%
Calm 0%
Confused 0%
Sad 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Male, 99.3%
Sad 58.6%
Calm 40.1%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.2%
Surprised 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 96.6%
Calm 45.2%
Sad 26.9%
Fear 21.3%
Surprised 1.7%
Angry 1.5%
Disgusted 1.3%
Confused 1.3%
Happy 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 93.2%
Painting 83.8%

Categories

Imagga

people portraits 96.7%
paintings art 3.2%

Text analysis

Amazon

MINE<

Google

MINE
MINE