Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)
Date

March 3, 1960-March 13, 1960
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5428

Human Generated Data

Title

Untitled (Fanling Babies Home, Hong Kong)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 3, 1960-March 13, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5428

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Furniture 98.6
Table 98.6
Baby 98.4
Person 98.4
Baby 97.3
Person 97.3
Face 96.7
Head 96.7
Person 96.7
Baby 96.4
Person 96.4
Baby 96.4
Person 96.4
Architecture 96.2
Building 96.2
School 96.2
Classroom 94.7
Indoors 94.7
Room 94.7
Baby 94.3
Person 94.3
Person 93.5
Person 91.8
Baby 91.7
Person 91.7
Dining Table 90.8
Baby 90.6
Person 90.6
Baby 89.9
Person 89.9
Person 86.8
Person 77
Person 71.9
Dining Room 60.8
Kindergarten 57.4
Restaurant 55.3

Clarifai
created on 2018-05-10

child 99.9
education 99.7
school 99.1
people 98.9
elementary school 98
group 97.8
classroom 97.7
boy 97.2
teacher 90.9
sit 88.5
son 87.3
schoolboy 86.7
room 86.3
adult 85.5
woman 84.3
desk 84.3
concentration 83.8
adolescent 83.1
elementary 83.1
book series 82.6

Imagga
created on 2023-10-06

classroom 61.9
room 41.9
male 37.4
people 35.7
together 34.2
man 33.6
group 32.3
happy 27.6
child 27.3
sitting 26.6
indoors 26.4
smiling 26.1
student 25.7
couple 24.4
person 24.3
education 24.3
home 23.1
adult 23.1
teacher 23
women 22.2
laptop 21.5
computer 21
friends 20.7
family 20.5
team 19.7
mother 19
meeting 18.8
happiness 18.8
school 17.6
friendship 16.9
students 16.6
men 16.3
learning 16
father 15.8
boy 15.7
20s 15.6
children 15.5
casual 15.3
love 14.2
adults 14.2
desk 14.2
teamwork 13.9
lifestyle 13.7
businesswoman 13.6
husband 13.6
smile 13.6
30s 13.5
technology 13.4
daughter 13.3
parent 13.1
study 13.1
portrait 13
girls 12.8
business 12.8
attractive 12.6
class 12.5
sibling 12.5
working 12.4
businessman 12.4
talking 12.4
fun 12
son 11.9
work 11.8
office 11.5
cheerful 11.4
professional 11.1
book 11
kid 10.6
studying 10.6
table 10.5
college 10.4
looking 10.4
day 10.2
indoor 10.1
color 10
relaxing 10
dad 9.8
brown hair 9.8
discussion 9.7
thirties 9.7
couch 9.7
daytime 9.6
enjoyment 9.4
successful 9.2
leisure 9.1
spa 9
childhood 9
40s 8.8
brunette 8.7
sofa 8.7
university 8.6
tub 8.6
businesspeople 8.5
living 8.5
togetherness 8.5
lying 8.5
communication 8.4
camera 8.3
inside 8.3
occupation 8.3
enrollee 8.2
discussing 7.9
casual clothing 7.8
colleagues 7.8
books 7.7
boyfriend 7.7
pretty 7.7
kin 7.7
four 7.7
laugh 7.7
loving 7.6
two 7.6
friend 7.6
reading 7.6
wife 7.6
horizontal 7.5
house 7.5
vessel 7.5
holding 7.4

Google
created on 2018-05-10

black 95.3
photograph 95.3
sitting 91.3
child 91
black and white 90.2
snapshot 81.8
photography 79.5
monochrome photography 76.7
human behavior 75.3
girl 73.6
furniture 70.9
table 66.3
conversation 63.8
monochrome 62.6
communication 58.3
education 58.3
smile 56.7
family 56.5
fun 52

Microsoft
created on 2018-05-10

person 99.7
child 98
boy 91
indoor 87.5
young 85.8
little 80.2
table 33.2
family 26.1
dining table 8.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 61.9%
Fear 63.3%
Calm 30.4%
Sad 7.9%
Surprised 7.6%
Happy 3.6%
Angry 2.2%
Disgusted 1.4%
Confused 1.1%

AWS Rekognition

Age 0-3
Gender Female, 99.7%
Sad 75.6%
Calm 55.5%
Confused 7.9%
Surprised 6.3%
Fear 6.3%
Disgusted 0.4%
Angry 0.3%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Female, 59.7%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 0-6
Gender Female, 95.1%
Calm 90.1%
Surprised 6.9%
Fear 6.3%
Sad 4.8%
Confused 0.8%
Happy 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Female, 90.8%
Sad 88.8%
Calm 54.8%
Fear 6.5%
Surprised 6.3%
Angry 1.1%
Confused 0.6%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 0-6
Gender Female, 100%
Fear 69.3%
Sad 17.1%
Happy 14.7%
Surprised 8.4%
Calm 7.7%
Disgusted 2%
Angry 1.9%
Confused 1%

AWS Rekognition

Age 1-7
Gender Female, 99%
Sad 87.2%
Calm 53%
Fear 7%
Surprised 6.8%
Disgusted 1%
Angry 0.9%
Confused 0.5%
Happy 0.4%

AWS Rekognition

Age 0-4
Gender Male, 83.3%
Sad 100%
Fear 10.4%
Surprised 6.6%
Calm 3.7%
Happy 1.2%
Disgusted 1.2%
Angry 1%
Confused 1%

AWS Rekognition

Age 0-4
Gender Female, 96.7%
Calm 92.3%
Surprised 7.3%
Fear 6%
Angry 4.2%
Sad 2.2%
Confused 0.6%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 93.6%
Calm 97.4%
Surprised 6.3%
Fear 5.9%
Sad 2.6%
Angry 0.3%
Happy 0.3%
Disgusted 0.2%
Confused 0.1%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Baby 98.4%
Person 98.4%

Categories

Imagga

interior objects 96.7%
people portraits 2.9%