Human Generated Data

Title

Untitled (family portrait, in front of fireplace)

Date

1958

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18824

Human Generated Data

Title

Untitled (family portrait, in front of fireplace)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.3
Person 99.3
Person 99.1
Person 96.4
Person 94
Person 93.9
Person 91.8
Person 91.7
Person 88.3
People 84.6
Apparel 81.1
Clothing 81.1
Person 80.7
Accessory 79.6
Accessories 79.6
Tie 79.6
Furniture 77.4
Couch 73.4
Chair 69
Door 64.5
Female 63
Sunglasses 62.9
Indoors 62.4
Room 62.4
Sitting 60.8
Girl 60.8
Kid 60.1
Child 60.1
Housing 59.4
Building 59.4
Kindergarten 57.7
Suit 56.6
Overcoat 56.6
Coat 56.6
Baby 56.4

Imagga
created on 2022-03-05

man 41
person 34.4
people 34
male 31.3
adult 29.9
home 26.3
couple 26.1
teacher 26.1
sitting 24
room 23.1
indoors 22.8
office 22.5
men 22.3
business 21.9
group 21.8
businessman 21.2
table 20.9
happy 20.7
laptop 19.5
indoor 19.2
women 19
chair 19
computer 18.8
professional 18.5
cheerful 17.9
together 17.5
smiling 17.4
meeting 17
lifestyle 15.9
educator 15.3
interior 15
happiness 14.9
mature 14.9
communication 14.3
smile 14.2
family 14.2
senior 14.1
education 13.9
work 13.4
executive 13.4
handsome 13.4
talking 13.3
desk 13.2
corporate 12.9
student 12.7
businesswoman 12.7
two 12.7
couch 12.6
businesspeople 12.3
worker 11.7
classroom 11.6
modern 11.2
brass 11.2
wind instrument 11.1
groom 10.9
suit 10.8
team 10.7
kin 10.5
friends 10.3
teamwork 10.2
confident 10
board 9.9
conference 9.8
job 9.7
working 9.7
colleagues 9.7
class 9.6
enjoying 9.5
20s 9.2
portrait 9.1
musical instrument 9
life 8.9
technology 8.9
child 8.8
looking 8.8
full length 8.7
boy 8.7
father 8.7
adults 8.5
casual 8.5
friendship 8.4
horizontal 8.4
house 8.4
furniture 8.4
holding 8.3
fun 8.2
director 8.1
students 7.8
teaching 7.8
two people 7.8
college 7.6
togetherness 7.6
relationship 7.5
study 7.5
presentation 7.4
hall 7.4
phone 7.4
inside 7.4
successful 7.3
new 7.3
color 7.2
romantic 7.1
face 7.1
love 7.1
kid 7.1
to 7.1
mother 7.1
grandfather 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Happy 87.5%
Calm 5.6%
Surprised 2.8%
Confused 1.7%
Disgusted 0.8%
Sad 0.6%
Fear 0.6%
Angry 0.4%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Calm 64%
Happy 30.4%
Disgusted 1.5%
Sad 1.5%
Confused 1.2%
Surprised 0.8%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 59.8%
Calm 99.1%
Happy 0.3%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 87.8%
Happy 98.9%
Calm 0.3%
Surprised 0.3%
Fear 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Female, 54.1%
Calm 99.7%
Surprised 0.1%
Sad 0.1%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 78.7%
Happy 96.3%
Calm 3.2%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 26-36
Gender Female, 76.6%
Calm 97.2%
Happy 2.1%
Sad 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 35-43
Gender Female, 90%
Happy 84.7%
Surprised 6.8%
Calm 6.1%
Sad 0.7%
Confused 0.5%
Fear 0.5%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 30-40
Gender Male, 74.7%
Calm 80%
Happy 7%
Sad 4.7%
Surprised 3.3%
Confused 2.1%
Fear 1.5%
Disgusted 1%
Angry 0.4%

AWS Rekognition

Age 25-35
Gender Female, 98.6%
Calm 99.8%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%
Confused 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 79.6%
Sunglasses 62.9%

Captions

Microsoft

a group of people sitting on a bed 64.7%
a group of people that are sitting on a bed 49%
a group of people sitting on top of a bed 48.9%

Text analysis

Amazon

as
MJI7-YT37AS

Google

MJIヨーYTヨヨA°2-AGO
ヨヨ
AGO
MJI
ヨー
°
YT
A
2
-