Human Generated Data

Title

Untitled (group portrait of large family with twenty people posed in front of fireplace)
Date

1942
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9921

Human Generated Data

Title

Untitled (group portrait of large family with twenty people posed in front of fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.5
Person 99.5
Person 99.4
Person 99.3
Person 99
Person 99
Person 98.8
Person 97.8
Person 97.7
Clothing 97.6
Apparel 97.6
Person 95.8
Person 94.8
Person 94.4
Person 94.4
Person 92
Shorts 92
School 90.9
Female 86.1
Dress 85.3
Room 81.4
Classroom 81.4
Indoors 81.4
Person 80
Person 76.6
Kid 75.8
Child 75.8
People 75.2
Person 72.7
Girl 70.5
Person 67.5
Person 67.4
Person 64.4
Furniture 63.5
Chair 63.3
Shoe 60
Footwear 60
Urban 59.9
Photography 58.4
Photo 58.4
Crowd 58.3
Kindergarten 57.6
Woman 55.9
Play 55.5
Building 55
Neighborhood 55

Imagga
created on 2022-01-29

man 42.6
nurse 42.1
businessman 40.6
male 39.7
people 38.5
business 35.8
person 35.4
group 33.8
team 30.4
professional 26.6
classroom 25.1
men 24.9
adult 24.8
meeting 23.5
together 22.8
room 22.5
job 22.1
businesswoman 21.8
happy 21.3
teamwork 19.5
success 19.3
work 18.8
suit 18
women 17.4
teacher 17.1
office 16.9
silhouette 16.5
worker 16.2
smiling 15.9
working 15.9
lifestyle 15.9
corporate 15.5
successful 14.6
colleagues 14.6
portrait 14.2
businesspeople 14.2
student 14
executive 13.8
smile 13.5
couple 13.1
standing 13
manager 12.1
mature 12.1
four 11.5
talking 11.4
desk 11.3
boy 11.3
sport 11.2
company 11.2
athlete 11
communication 10.9
black 10.8
employee 10.8
boss 10.5
career 10.4
blackboard 10.1
human 9.7
ballplayer 9.5
player 9.2
modern 9.1
holding 9.1
handsome 8.9
education 8.7
crowd 8.6
staff 8.6
educator 8.5
two 8.5
friends 8.4
occupation 8.2
life 8.2
fun 8.2
contestant 7.9
happiness 7.8
discussion 7.8
casual 7.6
gesture 7.6
finance 7.6
power 7.6
confident 7.3
looking 7.2
ball 7.2
family 7.1

Google
created on 2022-01-29

Style 83.9
Font 83.4
Black-and-white 82.8
Monochrome 72.9
Player 72.9
Football 72.8
Monochrome photography 71.5
Team sport 68.4
Team 68
T-shirt 67.3
Shorts 67
Room 66.2
Crew 66.2
Event 65.8
Ball 65.4
Personal protective equipment 65.1
Sports gear 64.7
Uniform 63.5
Stock photography 62.2
Visual arts 56.1

Microsoft
created on 2022-01-29

person 99.4
clothing 92.1
text 89.5
footwear 81.3
woman 67.7
group 63.5
man 60.5
people 59
posing 40.4
old 40.2

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 61.5%
Happy 96%
Calm 3%
Surprised 0.7%
Fear 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 33-41
Gender Male, 99.2%
Calm 88.9%
Happy 5.8%
Sad 1.8%
Surprised 1.4%
Disgusted 0.7%
Confused 0.6%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 40-48
Gender Male, 98.6%
Calm 68.8%
Sad 21.5%
Happy 5.8%
Disgusted 1.1%
Confused 1.1%
Surprised 0.8%
Angry 0.7%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 85.2%
Happy 6.8%
Sad 5%
Angry 0.9%
Confused 0.7%
Disgusted 0.6%
Surprised 0.5%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Calm 99.4%
Sad 0.3%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 86%
Happy 93.9%
Calm 3.6%
Surprised 1.4%
Sad 0.6%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 86%
Calm 98.6%
Happy 1%
Sad 0.2%
Surprised 0.1%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 40-48
Gender Male, 97%
Happy 97.2%
Sad 1.4%
Surprised 0.6%
Calm 0.6%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 96.5%
Happy 98.1%
Calm 0.9%
Sad 0.3%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 47-53
Gender Male, 96.8%
Happy 98.6%
Calm 1.2%
Surprised 0.1%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 98.5%
Calm 90.5%
Happy 4.3%
Sad 3.1%
Surprised 1%
Disgusted 0.4%
Confused 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 33-41
Gender Male, 95.3%
Calm 98.1%
Happy 0.7%
Sad 0.5%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Male, 66.2%
Happy 93.3%
Calm 6.2%
Sad 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%

AWS Rekognition

Age 48-54
Gender Female, 80.8%
Calm 93.7%
Happy 6%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 50-58
Gender Male, 88.1%
Sad 88.2%
Happy 7.3%
Fear 2.4%
Confused 0.9%
Disgusted 0.4%
Surprised 0.3%
Calm 0.3%
Angry 0.3%

AWS Rekognition

Age 52-60
Gender Male, 99.8%
Happy 92.5%
Surprised 2.8%
Sad 2.8%
Calm 0.7%
Angry 0.3%
Disgusted 0.3%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Female, 93.8%
Sad 51.5%
Calm 28.3%
Happy 10.1%
Fear 4.2%
Surprised 2.3%
Disgusted 1.9%
Confused 0.9%
Angry 0.8%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Calm 98.6%
Happy 1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Male, 85.4%
Calm 82.2%
Happy 13.9%
Surprised 1.7%
Sad 1.4%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 60%

Captions

Microsoft

a group of people posing for a photo 89.6%
a group of people standing in front of a crowd 88.8%
a group of people standing in front of a crowd posing for the camera 86%

Text analysis

Google

......
......