Human Generated Data

Title

Untitled (flag-lined assembly for church with man at podium and men in Greek military uniforms below)
Date

1950
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9326

Human Generated Data

Title

Untitled (flag-lined assembly for church with man at podium and men in Greek military uniforms below)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9326

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.1
Human 99.1
Person 98.9
Person 97.4
Person 96.7
Person 96.3
Person 96.3
Crowd 92.7
Person 91.5
Person 90
Person 86.7
Audience 84.9
Person 81.8
People 80.6
Stage 75.9
Person 73.8
Clothing 73.5
Apparel 73.5
Person 68.9
Person 60.8
Musical Instrument 59.9
Musician 59.9
Face 58.8
Festival 57.7
Indoors 55.2
Person 48.2

Clarifai
created on 2023-10-26

people 99.8
group 98
woman 97.4
man 96.3
adult 96
education 94.3
group together 93.7
many 92.4
school 92.1
child 91.9
music 91.4
administration 90
wear 89.1
outfit 88
ceremony 88
boy 84.3
leader 82.8
musician 80.3
dancing 79
dancer 78.9

Imagga
created on 2022-01-23

academic gown 89.9
gown 77.2
mortarboard 72.9
clothing 68.1
cap 60
outerwear 55
headdress 43.7
business 34
people 33.5
consumer goods 33.3
covering 33.2
man 30.9
businessman 29.1
male 28.4
group 25
corporate 23.2
meeting 21.7
men 21.5
office 20.9
adult 20.8
professional 19.6
businesswoman 19.1
work 18.8
businesspeople 18
suit 17.3
person 17.1
team 17
success 16.1
executive 15.1
happy 15
teamwork 14.8
women 14.2
smile 12.8
colleagues 12.6
communication 12.6
diversity 12.5
sitting 12
confident 11.8
day 11.8
smiling 11.6
standing 11.3
manager 11.2
mature 11.2
building 11.1
successful 11
attractive 10.5
workplace 10.5
education 10.4
black 10.2
20s 10.1
handsome 9.8
working 9.7
portrait 9.7
corporation 9.6
career 9.5
finance 9.3
job 8.8
indoors 8.8
together 8.8
couple 8.7
partnership 8.6
senior 8.4
pretty 8.4
metropolitan 8.4
holding 8.2
laptop 8.2
dress 8.1
computer 8
family 8
worker 8
student 8
lifestyle 7.9
discussing 7.9
university 7.8
hands 7.8
businessmen 7.8
40s 7.8
partners 7.8
jacket 7.7
old 7.7
tie 7.6
adults 7.6
friends 7.5
looking 7.2
life 7.2
happiness 7

Google
created on 2022-01-23

Black 89.9
Black-and-white 86
Hat 85.7
Style 84
Line 81.6
Font 75.8
Tints and shades 75.7
Monochrome 74.2
Monochrome photography 74.1
Rectangle 69.8
Event 66.2
Vintage clothing 65.2
Room 64.6
Metal 63.9
Suit 63.7
Stock photography 63.1
Pattern 60.7
History 59.6
Team 58.8
Symmetry 57.7

Microsoft
created on 2022-01-23

person 91.6
clothing 89.3
black and white 83.3
text 80.4
dance 72.2
dress 68.2
group 64.9
white 62.6
woman 59.4
old 47.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 85.9%
Surprised 50.6%
Happy 25.3%
Calm 10.3%
Sad 8%
Disgusted 2.3%
Confused 1.9%
Angry 1%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 97.2%
Calm 81.7%
Sad 5.3%
Confused 4.7%
Disgusted 2.3%
Happy 1.8%
Surprised 1.6%
Fear 1.6%
Angry 0.9%

AWS Rekognition

Age 14-22
Gender Male, 97.9%
Confused 33.3%
Calm 22.7%
Sad 19.6%
Happy 9%
Surprised 5.8%
Disgusted 4.8%
Angry 2.5%
Fear 2.2%

AWS Rekognition

Age 28-38
Gender Male, 95%
Happy 57.1%
Calm 29.1%
Surprised 9.3%
Disgusted 1.3%
Sad 1.2%
Angry 0.9%
Confused 0.7%
Fear 0.4%

AWS Rekognition

Age 21-29
Gender Male, 96.9%
Surprised 74.5%
Calm 20.4%
Sad 2%
Disgusted 0.8%
Angry 0.7%
Fear 0.7%
Confused 0.7%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 97.8%
Calm 43.2%
Sad 34%
Confused 14.4%
Angry 2%
Disgusted 1.9%
Surprised 1.9%
Happy 1.3%
Fear 1.2%

AWS Rekognition

Age 20-28
Gender Female, 85.9%
Calm 95.2%
Confused 1.9%
Fear 1%
Sad 0.9%
Disgusted 0.4%
Happy 0.3%
Surprised 0.2%
Angry 0.1%

AWS Rekognition

Age 34-42
Gender Male, 97.6%
Calm 95.1%
Happy 2.3%
Disgusted 0.8%
Confused 0.6%
Surprised 0.5%
Angry 0.4%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Calm 96%
Sad 1.1%
Confused 1%
Happy 0.9%
Surprised 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 85.9%
Calm 99.5%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 24-34
Gender Male, 90.3%
Happy 78.6%
Calm 14.8%
Surprised 2.6%
Disgusted 2%
Sad 0.9%
Fear 0.5%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 18-24
Gender Male, 89.2%
Calm 51.2%
Fear 12.8%
Surprised 10.6%
Sad 8%
Disgusted 5.9%
Happy 5%
Confused 4.9%
Angry 1.5%

AWS Rekognition

Age 27-37
Gender Female, 98.3%
Calm 89.2%
Angry 3.1%
Happy 2.8%
Sad 2.6%
Confused 1.1%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Male, 53.8%
Calm 37.9%
Confused 20.2%
Surprised 16.1%
Sad 8.1%
Disgusted 6.3%
Happy 5.9%
Fear 3.3%
Angry 2.2%

AWS Rekognition

Age 43-51
Gender Male, 71.9%
Calm 54.6%
Angry 16.3%
Surprised 7.6%
Sad 7.3%
Confused 4.4%
Disgusted 4%
Happy 3.1%
Fear 2.7%

AWS Rekognition

Age 28-38
Gender Male, 83.4%
Confused 45.5%
Calm 25.3%
Happy 14.2%
Surprised 7.3%
Sad 4.4%
Angry 1.6%
Disgusted 1.4%
Fear 0.4%

AWS Rekognition

Age 30-40
Gender Male, 95.4%
Calm 50.8%
Happy 33.5%
Angry 8.3%
Surprised 2.6%
Fear 1.5%
Confused 1.3%
Disgusted 1%
Sad 1%

AWS Rekognition

Age 2-10
Gender Male, 97.3%
Calm 99.2%
Disgusted 0.3%
Confused 0.1%
Sad 0.1%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 84.5%
Sad 41.9%
Happy 41.3%
Calm 5.2%
Angry 3.9%
Disgusted 3%
Surprised 1.8%
Confused 1.7%
Fear 1.1%

AWS Rekognition

Age 23-31
Gender Female, 52.3%
Happy 67.3%
Calm 24.9%
Fear 4.1%
Angry 1.1%
Disgusted 0.9%
Sad 0.9%
Surprised 0.5%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

streetview architecture 97%
text visuals 1.3%

Text analysis

Google

".......
".......