Human Generated Data

Title

Untitled (large group portrait of children and adults in front of Christmas tree)
Date

1962
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9870

Human Generated Data

Title

Untitled (large group portrait of children and adults in front of Christmas tree)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 99.7
Clothing 99.7
Person 99.1
Human 99.1
Person 99.1
Person 98.7
Person 97.4
Person 96.5
Person 95.8
Person 95.2
Person 93.9
Person 93.3
Person 93.3
Person 92.9
Tie 91.8
Accessories 91.8
Accessory 91.8
Person 88.2
Person 87.8
People 82.6
Meal 81.7
Food 81.7
Fashion 79.6
Robe 79.6
Person 78.7
Person 77.6
Outdoors 76.3
Person 76.3
Person 76.1
Nature 76.1
Gown 75.6
Face 74.9
Person 74.5
Female 73.1
Dress 68.4
Suit 65.4
Coat 65.4
Overcoat 65.4
Person 65.2
Wedding 63.6
Photo 62.8
Portrait 62.8
Photography 62.8
Kid 61.6
Child 61.6
Person 61.4
Crowd 59.7
Wedding Gown 59
Indoors 58.2
Woman 58.2
Sand 57.6
Chair 55.4
Furniture 55.4
Person 48.5

Imagga
created on 2022-01-28

people 27.9
male 27.6
man 26.3
person 24.4
classroom 19.7
men 19.7
kin 19.4
room 17.8
business 17.6
hospital 17.3
education 17.3
group 16.9
blackboard 16.7
businessman 15.9
happy 15.7
adult 15.3
student 14.4
women 14.2
silhouette 14.1
teacher 13.6
human 13.5
child 13.3
vintage 13.2
black 13.2
newspaper 13.1
portrait 12.9
old 12.5
world 11.7
class 11.6
office 11.4
school 10.9
smiling 10.8
life 10.8
success 10.5
boy 10.4
drawing 10.4
grunge 10.2
product 10.1
art 10
modern 9.8
creative 9.7
mail 9.6
hand 9.1
sign 9
postmark 8.9
teaching 8.8
stamp 8.7
couple 8.7
sport 8.7
diagram 8.6
chart 8.6
design 8.4
creation 8.3
letter 8.3
fun 8.2
retro 8.2
aged 8.1
board 8.1
team 8.1
activity 8.1
family 8
looking 8
circa 7.9
work 7.8
happiness 7.8
motion 7.7
nurse 7.7
crowd 7.7
outdoors 7.5
back 7.3
occupation 7.3
cheerful 7.3
indoor 7.3
graphic 7.3
computer 7.2
kid 7.1

Google
created on 2022-01-28

Black-and-white 82.5
Art 79.6
Adaptation 79.4
Font 79.3
Monochrome photography 72.2
Suit 71.5
Event 69.6
Room 69
Monochrome 67.7
Vintage clothing 67.2
History 66.9
Illustration 65.4
Visual arts 64.8
Stock photography 64.4
Paper product 64.1
Photo caption 63
Team 62
Photographic paper 58.1
Picture frame 53.1
Crowd 50.3

Microsoft
created on 2022-01-28

person 95.5
text 95.5
clothing 90.5
group 77.1
people 74.5
man 71
white 67.5
cartoon 58.3
drawing 56.4
posing 45.2
crowd 23.8

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 56%
Calm 98.1%
Sad 0.8%
Confused 0.4%
Disgusted 0.3%
Happy 0.3%
Surprised 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 47-53
Gender Male, 99.3%
Calm 90.7%
Sad 2.9%
Happy 2.9%
Confused 2.5%
Disgusted 0.4%
Surprised 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 89%
Sad 6%
Happy 3.6%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 36-44
Gender Male, 98.1%
Calm 99.6%
Confused 0.1%
Sad 0.1%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 99.6%
Sad 74%
Confused 14.4%
Disgusted 4.5%
Calm 2.5%
Happy 1.5%
Angry 1.3%
Surprised 1.1%
Fear 0.8%

AWS Rekognition

Age 45-51
Gender Male, 79.4%
Sad 79.7%
Calm 11.7%
Happy 4.6%
Confused 2%
Disgusted 1.1%
Angry 0.6%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 66.7%
Calm 90.9%
Sad 8.4%
Confused 0.3%
Happy 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 98.8%
Sad 76.1%
Calm 8.1%
Happy 4.2%
Confused 3.9%
Surprised 3.8%
Disgusted 2.3%
Angry 1.1%
Fear 0.4%

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Calm 79.9%
Sad 10.7%
Happy 6.1%
Confused 1.4%
Disgusted 0.7%
Angry 0.6%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 45-53
Gender Male, 72.9%
Sad 53.7%
Calm 33%
Happy 9.5%
Surprised 1.3%
Fear 0.7%
Confused 0.6%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 50-58
Gender Male, 99.5%
Sad 96.7%
Calm 0.9%
Confused 0.8%
Fear 0.5%
Happy 0.4%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Male, 72.9%
Sad 79.4%
Calm 17.3%
Happy 1.7%
Confused 1%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 95.8%
Calm 93.6%
Happy 2.3%
Surprised 1.5%
Sad 1.3%
Confused 0.5%
Disgusted 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 30-40
Gender Male, 98.7%
Calm 85.8%
Sad 7.3%
Happy 4.9%
Confused 0.8%
Fear 0.5%
Disgusted 0.3%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 36-44
Gender Male, 68.4%
Calm 73.4%
Sad 16.1%
Happy 6.3%
Confused 1.7%
Disgusted 1%
Angry 0.7%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 99.8%
Surprised 0.1%
Confused 0%
Sad 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 49.7%
Sad 41.8%
Confused 4.2%
Angry 2%
Disgusted 1.5%
Surprised 0.3%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 39-47
Gender Male, 98.9%
Calm 93.8%
Sad 2.6%
Happy 1.9%
Disgusted 0.5%
Confused 0.5%
Fear 0.2%
Angry 0.2%
Surprised 0.2%

AWS Rekognition

Age 38-46
Gender Female, 85.4%
Sad 57.9%
Calm 29%
Happy 5.9%
Confused 4.1%
Disgusted 1.5%
Angry 0.7%
Fear 0.5%
Surprised 0.3%

AWS Rekognition

Age 40-48
Gender Male, 98.9%
Calm 49.1%
Fear 37.3%
Surprised 3.4%
Sad 3.2%
Angry 2.7%
Disgusted 2%
Happy 1.8%
Confused 0.6%

AWS Rekognition

Age 29-39
Gender Male, 98.3%
Calm 95.7%
Disgusted 2.1%
Sad 0.5%
Confused 0.4%
Surprised 0.4%
Happy 0.4%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 28-38
Gender Male, 97%
Calm 95.3%
Happy 3%
Sad 0.9%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 37-45
Gender Male, 91.3%
Sad 50%
Calm 46.9%
Happy 1.6%
Fear 0.8%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Tie 91.8%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 91.8%
a group of people standing in front of a crowd 91.7%
a group of people posing for a photo 91.6%

Text analysis

Amazon

2
C
cl