Human Generated Data

Title

Untitled (three men in tuxedos, woman, and two men in suits seated in front of five women)

Date

c. 1945

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11253

Human Generated Data

Title

Untitled (three men in tuxedos, woman, and two men in suits seated in front of five women)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.5
Apparel 99.5
Overcoat 99.1
Coat 99.1
Human 99
Person 99
Person 98.9
Person 98.3
Person 97.6
Person 97.6
Person 97.3
Person 97.1
Person 96.7
Person 95.7
Person 94.4
Person 94.2
Suit 92.9
People 88.1
Tie 86.5
Accessory 86.5
Accessories 86.5
Tuxedo 86.1
Face 83.6
Shoe 80.7
Footwear 80.7
Tie 78.9
Sitting 77.9
Standing 76.6
Furniture 76.4
Crowd 70.6
Female 68.3
Man 63.3
Dress 59.7
Jacket 59.2
Blazer 59.2
Photo 58.7
Photography 58.7
Suit 58.5
Audience 58.3
Portrait 57.8
Suit 56.7
Suit 56.2
Attorney 55.4
Shoe 53.4

Imagga
created on 2022-01-23

kin 100
silhouette 30.6
people 28.4
sunset 24.3
man 22.2
person 20.2
black 19.9
male 19.1
adult 18.5
couple 15.7
group 14.5
love 14.2
happiness 14.1
brass 13.5
women 13.4
summer 12.2
evening 12.1
sky 12.1
beach 11.8
portrait 11.6
family 11.6
dusk 11.4
boy 11.3
happy 11.3
body 11.2
men 11.2
youth 11.1
outdoor 10.7
water 10.7
wind instrument 10.6
fun 10.5
sun 10.5
dark 10
fashion 9.8
businessman 9.7
together 9.6
two 9.3
hand 9.1
business 9.1
attractive 9.1
human 9
lady 8.9
sexy 8.8
walk 8.6
world 8.5
walking 8.5
friendship 8.4
sport 8.2
outdoors 8.2
celebration 8
lifestyle 7.9
model 7.8
joy 7.5
child 7.5
relationship 7.5
style 7.4
musical instrument 7.3
girls 7.3
dress 7.2
face 7.1

Google
created on 2022-01-23

Coat 87.2
Tree 83.7
Suit 78
Blazer 75.9
Formal wear 75.9
Vintage clothing 72.2
Classic 71.3
Event 70.6
Crew 70.1
White-collar worker 65.7
Font 64.7
Stock photography 64.2
Team 63.8
History 61.3
Family reunion 60.8
Plant 60.5
Sitting 59.9
Monochrome 57.8
Uniform 54.9
Retro style 52.3

Microsoft
created on 2022-01-23

clothing 95.9
outdoor 95.9
person 95.7
smile 95
text 92.6
man 89
posing 78.6
suit 77.9
black and white 69.5
group 59.9
woman 58.2
human face 57.6
crowd 0.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Female, 100%
Calm 83.1%
Confused 8.4%
Disgusted 3%
Angry 1.7%
Fear 1.3%
Surprised 1.1%
Sad 0.9%
Happy 0.4%

AWS Rekognition

Age 49-57
Gender Male, 99.4%
Calm 96.6%
Happy 1.9%
Confused 0.4%
Angry 0.3%
Surprised 0.2%
Sad 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 36-44
Gender Male, 100%
Calm 97.2%
Happy 0.9%
Confused 0.6%
Angry 0.6%
Sad 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Female, 99.1%
Calm 97.6%
Happy 0.7%
Sad 0.5%
Confused 0.4%
Angry 0.4%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 99.2%
Angry 0.3%
Confused 0.2%
Happy 0.2%
Sad 0%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 53-61
Gender Female, 100%
Calm 97.6%
Disgusted 1%
Confused 0.7%
Angry 0.2%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 94.6%
Angry 2.3%
Sad 1.1%
Confused 1%
Disgusted 0.3%
Happy 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 67-77
Gender Male, 99.8%
Calm 92.3%
Happy 5.3%
Sad 1%
Confused 0.4%
Angry 0.3%
Fear 0.3%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 48-56
Gender Female, 100%
Calm 76.9%
Happy 14.9%
Disgusted 2%
Confused 1.8%
Sad 1.6%
Angry 1.2%
Surprised 0.9%
Fear 0.8%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 93.6%
Happy 4.5%
Disgusted 0.4%
Confused 0.4%
Sad 0.3%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Female, 99.5%
Calm 82.3%
Confused 6%
Angry 3.8%
Sad 2.6%
Surprised 2.2%
Happy 1.3%
Fear 1%
Disgusted 0.8%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 57
Gender Female

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 71
Gender Male

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 45
Gender Male

Microsoft Cognitive Services

Age 58
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Suit 92.9%
Tie 86.5%
Shoe 80.7%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people posing for the camera 97.9%
a group of people posing for a picture 97.8%

Text analysis

Amazon

SE