Human Generated Data

Title

Untitled (group portrait of men in an industrial building)
Date

20th century
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22213

Human Generated Data

Title

Untitled (group portrait of men in an industrial building)

People

Artist: Unidentified Artist,

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 4.2002.22213

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.4
Human 99.4
Person 99.1
Person 98.8
Person 98.8
Person 98.7
Person 98.5
Person 98.2
Clothing 98
Apparel 98
Person 96.2
Person 95.9
Person 94
Person 91.9
Person 91.2
Person 88.8
Person 88.2
Person 85.9
People 84.1
Crowd 81.9
Person 81.5
Female 80.2
Person 77.3
Dress 72.7
Face 66.6
Person 65.9
Meal 65.2
Food 65.2
Shorts 63.5
Suit 63.5
Coat 63.5
Overcoat 63.5
Girl 62.3
Woman 61.9
Photography 59.4
Photo 59.4
Stage 57.1
Audience 55.3
Person 44.6

Clarifai
created on 2023-10-22

people 99.9
group 99.6
many 99.2
group together 98.7
child 96.7
adult 96.2
music 95.7
man 95.6
education 94
woman 92.7
boy 90.7
school 90.7
dancing 90.2
wear 88.7
musician 88.6
recreation 87.5
leader 87.1
several 86.9
administration 86.7
dancer 85.6

Imagga
created on 2022-03-11

passenger 21.8
clothing 19.1
people 18.9
hospital 18.4
brassiere 17.4
shop 17.2
man 14.8
woman's clothing 14
undergarment 14
mercantile establishment 13.2
person 12.9
party 12
black 12
garment 11.8
fashion 11.3
covering 10.9
consumer goods 10.8
dark 10.8
music 10.8
city 10.8
art 10.8
barbershop 10.7
crowd 10.5
men 10.3
light 10
life 9.9
male 9.9
adult 9.9
old 9.7
portrait 9.7
place of business 9.7
urban 9.6
bride 9.6
ride 9.5
carousel 9.2
human 9
stage 9
group 8.9
shoe shop 8.5
grunge 8.5
design 8.5
smoke 8.4
silhouette 8.3
style 8.1
dress 8.1
celebration 8
women 7.9
couple 7.8
world 7.8
scene 7.8
concert 7.8
motion 7.7
culture 7.7
sax 7.6
entertainment 7.4
wedding 7.3
dancer 7.3
color 7.2
lifestyle 7.2
body 7.2
religion 7.2
science 7.1
night 7.1
modern 7

Google
created on 2022-03-11

Black 89.5
Black-and-white 82.9
Font 80.5
Monochrome photography 74.8
Monochrome 74.7
Event 69.5
Crew 68.7
Room 66.2
History 62.8
Stock photography 61.9
Suit 61.4
Team 57.5
Visual arts 55.7
Metal 55.2
Vintage clothing 50.8

Microsoft
created on 2022-03-11

text 94.6
person 93.5
clothing 92.1
man 56.7
posing 36
clothes 31.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 97.8%
Sad 1.3%
Confused 0.6%
Angry 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 96.1%
Sad 2.2%
Happy 0.7%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Sad 93.3%
Calm 5.3%
Confused 0.4%
Happy 0.3%
Disgusted 0.2%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 49-57
Gender Male, 99.4%
Calm 99.9%
Confused 0%
Surprised 0%
Disgusted 0%
Sad 0%
Angry 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 95.7%
Calm 66.8%
Surprised 8.8%
Happy 5.5%
Confused 5.2%
Sad 4.7%
Fear 4.3%
Angry 3%
Disgusted 1.7%

AWS Rekognition

Age 28-38
Gender Female, 89%
Calm 71.9%
Sad 9.9%
Fear 8.8%
Happy 3.7%
Confused 1.9%
Surprised 1.7%
Angry 1.3%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Male, 78.8%
Sad 80.1%
Calm 16.4%
Happy 2.1%
Angry 0.4%
Fear 0.4%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.8%
Calm 98.5%
Happy 0.6%
Surprised 0.2%
Sad 0.2%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 94.6%
Calm 53.4%
Sad 24.6%
Fear 9.6%
Happy 4.1%
Confused 3.3%
Angry 2.3%
Disgusted 1.8%
Surprised 1.1%

AWS Rekognition

Age 23-31
Gender Female, 59.6%
Calm 42.6%
Happy 23.8%
Sad 22.8%
Fear 3.5%
Surprised 2.2%
Disgusted 2.1%
Confused 2%
Angry 1%

AWS Rekognition

Age 28-38
Gender Male, 99.1%
Sad 87.3%
Calm 5.6%
Happy 5%
Confused 1.3%
Angry 0.4%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 95.2%
Calm 99.8%
Sad 0.1%
Surprised 0%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 51-59
Gender Male, 99.3%
Confused 42.8%
Calm 19.6%
Disgusted 11.3%
Happy 11%
Sad 9.2%
Angry 3%
Fear 1.7%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Male, 95.9%
Calm 71.1%
Sad 19.4%
Disgusted 2.8%
Happy 2%
Fear 1.5%
Angry 1.4%
Confused 1.3%
Surprised 0.4%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 96.2%
Surprised 1.6%
Angry 0.7%
Sad 0.5%
Happy 0.4%
Disgusted 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.2%
Calm 93.9%
Happy 4.9%
Sad 0.5%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 58.2%
Calm 99.3%
Disgusted 0.2%
Angry 0.1%
Sad 0.1%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 31-41
Gender Female, 87.6%
Sad 90.8%
Calm 7.4%
Happy 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 88.6%
Sad 5.1%
Confused 2%
Surprised 1.6%
Angry 1%
Happy 0.8%
Disgusted 0.5%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 63.3%
Calm 81%
Sad 13.5%
Happy 1.4%
Confused 1.4%
Disgusted 1.1%
Angry 0.7%
Fear 0.5%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.4%
Person 99.1%
Person 98.8%
Person 98.8%
Person 98.7%
Person 98.5%
Person 98.2%
Person 96.2%
Person 95.9%
Person 94%
Person 91.9%
Person 91.2%
Person 88.8%
Person 88.2%
Person 85.9%
Person 81.5%
Person 77.3%
Person 65.9%
Person 44.6%

Categories

Imagga

paintings art 82.5%
streetview architecture 8.7%
interior objects 7%