Human Generated Data

Title

Untitled (two photographs: young children posing in for first communion ceremony with priests at front of church; two men shaking hands while one holds auto award)

Date

1948, printed later

People

Artist: Orrion Barger, American active 1913 - 1984

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6689

Human Generated Data

Title

Untitled (two photographs: young children posing in for first communion ceremony with priests at front of church; two men shaking hands while one holds auto award)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1948, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 98.9
Person 98.9
Person 98.7
Person 98.7
Crowd 98.4
Audience 98.4
Person 97.4
Person 97.4
Person 96.4
Person 91.4
Speech 91.3
Person 82.6
Accessories 81.4
Accessory 81.4
Tie 81.4
Suit 80.6
Overcoat 80.6
Coat 80.6
Apparel 80.6
Clothing 80.6
Suit 79
Lecture 72.6
People 69.7
Tie 65.4
Press Conference 59.1
Face 57.1
Home Decor 55.2

Imagga
created on 2022-01-22

newspaper 46.4
product 35.2
man 35
people 29.6
business 29.2
creation 27.5
adult 25.6
person 25.4
male 22.9
office 21.1
businesswoman 20
businessman 19.4
professional 19.4
indoors 19.3
corporate 18.9
room 18.7
attractive 16.8
shop 16.4
sitting 16.3
computer 15.3
smiling 14.5
barbershop 14.3
suit 14
occupation 13.8
indoor 13.7
laptop 13.7
looking 13.6
casual 13.6
work 13.3
interior 13.3
executive 12.9
20s 12.8
holding 12.4
portrait 12.3
black 12.1
happy 11.9
mercantile establishment 11.6
lifestyle 11.6
working 11.5
smile 11.4
call 11.2
home 11.2
technology 11.1
women 11.1
alone 11
job 10.6
fashion 10.6
pretty 10.5
career 10.4
student 10.1
modern 9.8
businesspeople 9.5
men 9.4
meeting 9.4
manager 9.3
window 9.3
building 9.3
communication 9.2
face 9.2
confident 9.1
cheerful 8.9
group 8.9
clothing 8.9
success 8.9
couple 8.7
brunette 8.7
1 8.7
education 8.7
expression 8.5
youth 8.5
desk 8.5
one person 8.5
teamwork 8.3
style 8.2
standing 7.8
place of business 7.7
old 7.7
boss 7.7
serious 7.6
talking 7.6
studio 7.6
living 7.6
keyboard 7.5
one 7.5
mature 7.4
device 7.3
team 7.2
family 7.1
life 7.1
happiness 7.1

Google
created on 2022-01-22

Photograph 94.2
Coat 90.3
Black 89.6
Black-and-white 84.7
Style 84
Suit 81.8
Monochrome 76.6
Monochrome photography 75.4
Snapshot 74.3
Picture frame 69.9
Event 69.7
History 66.9
Room 65.4
Vintage clothing 64.8
White-collar worker 64.4
Door 61.2
Machine 58.1
Art 57.7
Classic 55.9

Microsoft
created on 2022-01-22

person 98.6
text 97.7
clothing 97.2
black and white 90.2
man 86.4
standing 76.6
human face 52
old 40.4

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 97%
Happy 63.9%
Sad 20.8%
Fear 6.8%
Calm 2.5%
Disgusted 2.3%
Angry 1.8%
Surprised 1.3%
Confused 0.7%

AWS Rekognition

Age 26-36
Gender Female, 87.5%
Calm 92.7%
Sad 5.8%
Confused 0.7%
Angry 0.5%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 14-22
Gender Female, 50.4%
Confused 66.5%
Calm 16.2%
Sad 9.8%
Angry 5.1%
Fear 0.9%
Disgusted 0.8%
Happy 0.4%
Surprised 0.3%

AWS Rekognition

Age 9-17
Gender Female, 74.3%
Calm 70.5%
Fear 8.6%
Sad 7.8%
Confused 3.8%
Angry 3.7%
Surprised 3.3%
Disgusted 1.6%
Happy 0.8%

AWS Rekognition

Age 2-10
Gender Male, 99.3%
Calm 86.9%
Sad 5.1%
Angry 3.7%
Confused 1.6%
Disgusted 1.2%
Fear 0.7%
Happy 0.4%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 96.5%
Angry 2.2%
Sad 0.5%
Confused 0.3%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 34-42
Gender Female, 99.9%
Happy 54.9%
Confused 29.6%
Sad 4.7%
Angry 3.4%
Surprised 3%
Fear 1.9%
Disgusted 1.8%
Calm 0.9%

AWS Rekognition

Age 10-18
Gender Female, 54.2%
Surprised 34.4%
Confused 24%
Calm 13.6%
Disgusted 10.2%
Angry 5.3%
Sad 5.2%
Fear 4.2%
Happy 2.9%

AWS Rekognition

Age 18-24
Gender Female, 97.6%
Sad 63.9%
Happy 22.4%
Confused 10.9%
Calm 1.1%
Fear 0.7%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 37-45
Gender Male, 99.3%
Happy 99.3%
Calm 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 31-41
Gender Female, 100%
Sad 59.4%
Fear 20.9%
Confused 9.3%
Angry 4.7%
Disgusted 2%
Surprised 1.9%
Calm 1.1%
Happy 0.7%

AWS Rekognition

Age 25-35
Gender Male, 99.9%
Calm 99.6%
Sad 0.2%
Confused 0.1%
Angry 0%
Fear 0%
Surprised 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 23-31
Gender Female, 100%
Happy 52.3%
Calm 27.3%
Angry 6.8%
Surprised 5.5%
Confused 4.2%
Disgusted 2.1%
Sad 1.1%
Fear 0.7%

AWS Rekognition

Age 36-44
Gender Male, 98.5%
Happy 98.7%
Surprised 0.3%
Disgusted 0.3%
Confused 0.3%
Fear 0.2%
Angry 0.1%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 21-29
Gender Female, 67.2%
Sad 69.7%
Calm 15.6%
Angry 11.5%
Confused 0.8%
Disgusted 0.8%
Fear 0.6%
Happy 0.5%
Surprised 0.3%

AWS Rekognition

Age 24-34
Gender Male, 63.2%
Angry 56.1%
Happy 12.7%
Calm 12.5%
Surprised 9.7%
Sad 3.6%
Disgusted 1.9%
Fear 1.8%
Confused 1.5%

AWS Rekognition

Age 22-30
Gender Female, 93.8%
Calm 62.3%
Sad 32.7%
Angry 1.2%
Fear 1.1%
Confused 0.9%
Happy 0.8%
Disgusted 0.7%
Surprised 0.3%

AWS Rekognition

Age 6-12
Gender Female, 90.9%
Calm 67.9%
Happy 20.1%
Sad 5.6%
Fear 1.7%
Surprised 1.5%
Confused 1.3%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 20-28
Gender Female, 100%
Fear 90.5%
Sad 3.8%
Surprised 1.5%
Calm 1.5%
Angry 1.4%
Confused 0.5%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 73.9%
Sad 8.1%
Happy 7.3%
Angry 3%
Disgusted 2.2%
Surprised 2%
Confused 1.9%
Fear 1.6%

AWS Rekognition

Age 18-24
Gender Male, 96.4%
Sad 61.9%
Calm 24.2%
Angry 3.7%
Disgusted 2.7%
Surprised 2.3%
Confused 2.1%
Fear 1.9%
Happy 1.1%

AWS Rekognition

Age 7-17
Gender Female, 53%
Calm 59.4%
Sad 15.7%
Angry 11.9%
Disgusted 9%
Fear 1.4%
Happy 1%
Confused 1%
Surprised 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 81.4%
Suit 80.6%

Captions

Microsoft

a man standing in front of a store 66%
a man and a woman standing in front of a store 46.1%
a group of people standing in front of a store 46%

Text analysis

Amazon

APRIL
1948
APRIL 25
25
FIRST
COMMUNION
Kask
-
..
.. - -
Rask
11 - - 11
11

Google

Zesk FIRST COMMUNION APRIL 25 1948
COMMUNION
APRIL
25
Zesk
FIRST
1948