Human Generated Data

Title

Untitled (wedding group portrait, East Coast)

Date

1950s

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.887

Human Generated Data

Title

Untitled (wedding group portrait, East Coast)

People

Artist: Bachrach Studios, founded 1868

Date

1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.8
Human 98.8
Person 98.8
Person 98.6
Person 98.6
Person 98.1
Person 97.9
Person 97.8
Person 97.6
Person 96.4
Person 92.8
Clothing 90.3
Apparel 90.3
Crowd 83.2
Musical Instrument 82.9
Musician 82.9
Person 82.1
Music Band 76.4
People 76.4
Military 73.7
Military Uniform 71.2
Coat 64.9
Overcoat 64.6
Suit 64.6
Officer 62.6
Brass Section 62.1
Face 61.7
Horn 60.7
Poster 59.3
Advertisement 59.3
Sailor Suit 58.1

Imagga
created on 2022-01-23

people 35.1
business 32.8
man 32
male 31.9
silhouette 31.4
group 31.4
businessman 30
team 28.6
crowd 27.8
men 24.9
person 23.1
work 22
success 20.9
teamwork 20.4
black 19.4
adult 18.3
photographer 17.9
businesswoman 17.3
office 17
world 16.9
walking 15.1
women 15
suit 14.9
occupation 14.7
corporate 14.6
boss 14.3
job 13.3
human 12
design 11.2
portrait 11
meeting 10.4
manager 10.2
bag 10.1
clothing 9.7
art 9.6
mine 9.4
company 9.3
executive 9.2
vintage 9.1
old 9.1
fashion 9
shadow 9
professional 8.7
urban 8.7
couple 8.7
leader 8.7
leadership 8.6
smile 8.5
military uniform 8.5
staff 8.3
sign 8.3
global 8.2
symbol 8.1
worker 8
sexy 8
graphic 8
looking 8
body 8
boy 8
standing 7.8
jacket 7.8
modern 7.7
walk 7.6
career 7.6
shopping 7.6
friends 7.5
excavation 7.5
friendship 7.5
uniform 7.5
active 7.2
room 7.2
activity 7.2
covering 7
life 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.9
person 98.2
clothing 97.8
group 93.7
people 93.7
standing 89.3
posing 88.7
man 87.7
suit 82.3
woman 78.3
dress 64
wedding dress 57.5
bride 54

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 74.9%
Calm 11%
Fear 3.3%
Surprised 3.2%
Sad 2.9%
Angry 2.5%
Disgusted 1.2%
Confused 0.9%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Happy 92.3%
Calm 3.5%
Surprised 2.6%
Fear 0.4%
Angry 0.4%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 47-53
Gender Female, 50.2%
Calm 91.1%
Happy 2.9%
Surprised 2%
Confused 1.8%
Sad 0.9%
Disgusted 0.5%
Fear 0.5%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Female, 81%
Happy 97.5%
Surprised 0.6%
Calm 0.6%
Confused 0.3%
Angry 0.3%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Happy 99.7%
Surprised 0.2%
Confused 0%
Fear 0%
Angry 0%
Disgusted 0%
Sad 0%
Calm 0%

AWS Rekognition

Age 1-7
Gender Male, 93.7%
Sad 63.4%
Calm 28.3%
Angry 3.3%
Happy 2.3%
Disgusted 1%
Fear 0.8%
Confused 0.6%
Surprised 0.3%

AWS Rekognition

Age 42-50
Gender Female, 99.6%
Angry 46.6%
Happy 46.6%
Disgusted 2.2%
Fear 1.2%
Surprised 1.1%
Confused 1%
Sad 0.7%
Calm 0.6%

AWS Rekognition

Age 18-26
Gender Male, 62.1%
Angry 44.4%
Surprised 33.1%
Fear 11.9%
Sad 6.4%
Happy 1.7%
Calm 1.3%
Disgusted 0.8%
Confused 0.4%

AWS Rekognition

Age 35-43
Gender Male, 98.7%
Happy 88.4%
Sad 3.6%
Fear 2.4%
Angry 1.5%
Disgusted 1.3%
Surprised 1.1%
Calm 0.9%
Confused 0.7%

AWS Rekognition

Age 47-53
Gender Female, 97.8%
Sad 48%
Calm 24%
Fear 11.3%
Surprised 5.2%
Disgusted 3.4%
Happy 3.2%
Angry 3%
Confused 1.9%

AWS Rekognition

Age 20-28
Gender Male, 98.9%
Angry 78.4%
Fear 10%
Sad 5.2%
Disgusted 2%
Calm 1.8%
Surprised 1%
Happy 0.9%
Confused 0.6%

AWS Rekognition

Age 31-41
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Angry 0%
Confused 0%
Calm 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 76%
Confused 11%
Disgusted 3.9%
Angry 2.4%
Happy 2.3%
Sad 2%
Surprised 1.3%
Fear 1.1%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Happy 99.4%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0%
Calm 0%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Happy 26%
Surprised 20.7%
Sad 13.8%
Fear 11.8%
Calm 11.8%
Confused 8.8%
Angry 3.7%
Disgusted 3.4%

AWS Rekognition

Age 22-30
Gender Female, 92.1%
Surprised 33.8%
Sad 21.4%
Angry 19%
Fear 8.6%
Happy 7.7%
Calm 3.3%
Confused 3.1%
Disgusted 3%

AWS Rekognition

Age 52-60
Gender Male, 99.3%
Calm 85.8%
Sad 7.5%
Fear 1.9%
Angry 1.5%
Surprised 1.2%
Disgusted 1%
Confused 0.8%
Happy 0.2%

AWS Rekognition

Age 53-61
Gender Male, 99.9%
Calm 85.2%
Sad 4.8%
Happy 4.7%
Surprised 2.9%
Angry 0.8%
Fear 0.6%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 13-21
Gender Male, 99.1%
Happy 43.4%
Sad 23.5%
Calm 17%
Fear 5.9%
Angry 4.1%
Surprised 2.4%
Disgusted 2.4%
Confused 1.4%

AWS Rekognition

Age 18-24
Gender Female, 92.3%
Happy 66.4%
Fear 16.2%
Angry 5.1%
Calm 3.9%
Disgusted 3.1%
Sad 3%
Surprised 1.2%
Confused 1.1%

AWS Rekognition

Age 50-58
Gender Male, 98.1%
Calm 28.3%
Fear 28.2%
Sad 12.7%
Angry 12.2%
Surprised 8.4%
Confused 5.1%
Happy 2.7%
Disgusted 2.5%

AWS Rekognition

Age 41-49
Gender Female, 99.5%
Happy 99.2%
Surprised 0.2%
Fear 0.1%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 80.9%
Calm 53.8%
Fear 10.5%
Sad 9.1%
Happy 8.1%
Angry 7.1%
Surprised 4.7%
Disgusted 4.3%
Confused 2.4%

AWS Rekognition

Age 28-38
Gender Male, 88.9%
Happy 47.7%
Calm 24%
Surprised 15.8%
Sad 7.1%
Angry 2%
Fear 1.7%
Disgusted 1.4%
Confused 0.3%

AWS Rekognition

Age 21-29
Gender Female, 80.6%
Calm 95.5%
Sad 1.4%
Disgusted 0.9%
Surprised 0.7%
Fear 0.6%
Confused 0.4%
Happy 0.3%
Angry 0.2%

AWS Rekognition

Age 18-24
Gender Female, 72.7%
Happy 30.1%
Sad 20.1%
Fear 16%
Angry 15.3%
Calm 12%
Disgusted 2.4%
Confused 2.2%
Surprised 1.9%

AWS Rekognition

Age 21-29
Gender Female, 77.2%
Calm 85.8%
Sad 2.8%
Disgusted 2.7%
Fear 2.3%
Happy 2.2%
Angry 2%
Confused 1.5%
Surprised 0.9%

AWS Rekognition

Age 33-41
Gender Female, 76.7%
Sad 41.2%
Angry 25.8%
Disgusted 10.8%
Calm 10.6%
Fear 7.1%
Happy 1.7%
Surprised 1.6%
Confused 1.2%

AWS Rekognition

Age 18-26
Gender Female, 53.8%
Calm 99.4%
Surprised 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Female, 88.7%
Calm 99.2%
Fear 0.3%
Surprised 0.1%
Happy 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Poster 59.3%

Captions

Microsoft

a group of people posing for a photo 97.7%
a group of people standing in front of a crowd posing for the camera 96.3%
a group of people posing for the camera 96.2%

Text analysis

Amazon

106
118
Page 118
Page
10090
n.d.
Budrad

Google

106 100% Page /18 Buchad
106
Page
/18
100%
Buchad